Adversarial Manifold Estimation

نویسندگان

چکیده

This paper studies the statistical query (SQ) complexity of estimating $d$-dimensional submanifolds in $\mathbb{R}^n$. We propose a purely geometric algorithm called Manifold Propagation, that reduces problem to three natural routines: projection, tangent space estimation, and point detection. then provide constructions these routines SQ framework. Given an adversarial $\mathrm{STAT}(\tau)$ oracle target Hausdorff distance precision $\varepsilon = \Omega(\tau^{2 / (d + 1)})$, resulting manifold reconstruction has $O(n \operatorname{polylog}(n) \varepsilon^{-d 2})$, which is proved be nearly optimal. In process, we establish low-rank matrix completion results for SQ's lower bounds randomized estimators general metric spaces.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Manifold Assumption and Defenses Against Adversarial Perturbations

In the adversarial-perturbation problem of neural networks, an adversary starts with a neural network model F and a point x that F classifies correctly, and applies a small perturbation to x to produce another point x′ that F classifies incorrectly. In this paper, we propose taking into account the inherent confidence information produced by models when studying adversarial perturbations, where...

متن کامل

Minimax Manifold Estimation

We find the minimax rate of convergence in Hausdorff distance for estimating a manifold M of dimension d embedded in R given a noisy sample from the manifold. Under certain conditions, we show that the optimal rate of convergence is n−2/(2+d). Thus, the minimax rate depends only on the dimension of the manifold, not on the dimension of the space in which M is embedded.

متن کامل

Manifold Regularized Deep Neural Networks using Adversarial Examples

Learning meaningful representations using deep neural networks involves designing efficient training schemes and well-structured networks. Currently, the method of stochastic gradient descent that has a momentum with dropout is one of the most popular training protocols. Based on that, more advanced methods (i.e., Maxout and Batch Normalization) have been proposed in recent years, but most stil...

متن کامل

Manifold-valued Image Generation with Wasserstein Adversarial Networks

Unsupervised image generation has recently received an increasing amount of attention thanks to the great success of generative adversarial networks (GANs), particularly Wasserstein GANs. Inspired by the paradigm of real-valued image generation, this paper makes the first attempt to formulate the problem of generating manifold-valued images, which are frequently encountered in real-world applic...

متن کامل

The Robust Manifold Defense: Adversarial Training using Generative Models

Deep neural networks are demonstrating excellent performance on several classical vision problems. However, these networks are vulnerable to adversarial examples, minutely modified images that induce arbitrary attacker-chosen output from the network. We propose a mechanism to protect against these adversarial inputs based on a generative model of the data. We introduce a pre-processing step tha...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Foundations of Computational Mathematics

سال: 2022

ISSN: ['1615-3383', '1615-3375']

DOI: https://doi.org/10.1007/s10208-022-09588-2